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Abstract 

For the so (4) free rigid body the stability problem for isolated equilibria has been completely 
solved using Lie-theoretical and topological arguments. For each case of nonlinear stability previ- 
ously found we construct a Lyapunov function. These Lyapunov functions are linear combinations 
of Mishchenko's constants of motion. 
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1 Introduction 

The goal of this paper is to prove stability using energy methods for the Cartan type equilibria of 
so (4) free rigid body. More precisely, for each case of nonlinear stability, we will explicitly construct 
a Lyapunov function. We find these Lyapunov functions to be linear combinations of four integrals of 
motion which make the system completely integrable. These linear combinations of constants of motion 
are distinct for different nonlinear stable equilibria. 

As proved in [2J, there are three Cartan families of equilibria, organized in Weyl group orbits ge- 
nerated by three coordinate type Cartan subalgebras intersected with a regular adjoint orbit. Their 
stability is studied in [2 using exclusively a Lie-theoretical result due to Williamson [35]. The above 
equilibria are grouped in three categories: 

(I) a class of center-saddle unstable equilibria; 

(II) a class of center-center stable equilibria for which the stability does not depend on the parameters 
defining the corresponding orbit; 

(III) a class of equilibria for which a bifurcation phenomenon occurs, depending on the parameters 
defining the corresponding orbit (the stability region being also of center-center type). 

For equilibria of type (II) we find Lyapunov functions which guarantee their stability using linear 
combinations of Mishchenko's constants of motion, as described in [17] . 

For equilibria of type (III) we first study their spectral stability and we find that a bifurcation 
phenomenon in the spectral stability occurs. The region of spectral stability overlaps the region of 
nonlinear stability previously discovered in [2J. For each region of nonlinear stability found in [5J we 
construct a Lyapunov function. We also point out a frontier case of spectral stability which is nonlinear 
unstable. 

Although the constants of motion used in our paper are functionally dependent of the Mishchenko's 
first integrals, they prove their utility in applying energy methods for studying stability of equilibria. 
This paper completes previous results on nonlinear stability using energy methods [7], [20] . The sta- 
bility problem and the implication of the topological structure of the energy-momentum level sets on 
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bifurcation phenomena in the dynamics of the so (4) free rigid body was extensively studied in [T3], |14) . 

m- ma. ED- 

We prove that Lyapunov functions are positive or negative definite studying the non-degeneracy of 
the Hessian matrix associated to the Lyapunov function at the equilibrium point. If the Hessian is 
degenerate at an equilibrium point, one can still study the Lyapunov stability using algebraic methods, 
see [6]. 



2 The geometry and stability problem for the 50 (4) free rigid 
body 

In the first part of this section, we recall the geometry underlying the system of the free rigid body on 
the Lie algebra so (4), as it was presented in [2J. The equations of the rigid body on so (4) are given by 



m = [M,n], 



(2.1) 



where f2 € so (4), M — HJ + Jil E so (4) with J — diag(A,), a real constant diagonal matrix satisfying 
A, + Xj > 0, for all i, j = 1, . . . , 4, i ^ j (see, for example, [E]). Note that M = [my] and fl = [wy] 
determine each other if and only if A; + Xj > since my = (A; + Aj)wy which physically means that 
the rigid body is not concentrated on a lower dimensional subspace of M 6 . 

It is well known that equations (|2.1I) are Hamiltonian relative to the minus Lie-Poisson bracket on 
so(4) 

{F, G}(M) := iTrace(M[V^(M),VG(M)]), 



and the Hamiltonian function 

H{M) 

We choose as basis of so (4) the matrices 
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and hence we represent so (4) as 
so (4) = { M 
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(2.4) 



Since rankso(4) = 2, we have two functionally independent Casimir functions which are given respec- 
tively by 



and 



Ci(M) := -\ Trace(M 2 ) = \ f]T>? + ]T> A 

i=i ) 



C 2 (M) :=-Pi(M) = Y / x i y i 

i=l 
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Thus the generic adjoint orbits are the level sets 

Orb clC2 (M) = (Cj x C 2 )- 1 (c 1 ,c 2 ), 



(ci,c 2 ) e 



In all that follows we will denote by Orb Ci;C2 the regular adjoint orbit Orb ClC2 , where c\ > and 
ci > |c 2 |. 

We will work from now on with a generic so(4)-rigid body, that is, Ai + Xj > for i j and all Xi are 
distinct. The relationship between ft — [oJij] £ so(4) and the matrix M g so(4) in the representation 
(|2.4[) is hence given by 

(A 3 + X 2 )u>32 = xi (Ai + A 3 )o;i3 = x 2 (X 2 + Xi)u 21 = x 3 
(Ai + A 4 )wi4 = yi (A 2 + A 4 )cj 24 = y 2 (A 3 + A 4 )w 34 = 2/3 

and thus the equations of motion (|2.1I) are equivalent to the system 
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(2.5) 



The Hamiltonian 



has the expression 



H(M) 



-Trace(Mfi) 
1 



2 U2 + A3 A1+A3 
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Theorem 2.1. 0/ //£ denotes the set of the equilibrium points of (|2.5I) . i/ien £ = ti U t 2 U t 3 Us+ Us_ , 

where 



ti := < 
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are the coordinate type Cartan subalgebras of so (A) and s± are the three dimensional vector subspaces 
given by 



s± :=span M \ f^-^i 



\2+>^3 Ei ) ' I A2+A4 



-Eo± 



Xi+Xs^ 5 ) ' I A3+A4 
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The intersection of a regular adjoint orbit and a coordinate type Cartan subalgebra has four elements 
which represents a Weyl group orbit. Thus we expect twelve isolated equilibria for the rigid body 
equations (|2.ip . Specifically, we have the following result. 

Theorem 2.2. The following equalities hold: 

(i) t!nOrb ci;C2 = {Ml b ,Ml at _ b ,Ml a ,M\_ a }, 

(ii) t 2 nOrb Ci;C2 = {Ml b ,AP a _ b ,Ml a ,M\_ a }, 

(iii) t 3 nOrb Ci;C2 = {Ml b ,M\_ b ,Ml a ,M\_ a }, 
where 

!a = —= (y/d + c 2 + \fc~i - c 2 ) 
b = -j= (vci + c 2 - \fc~i - c 2 ) . 

Further we remind the main results obtained in [5] on the nonlinear stability of the equilibrium 
states £ n Orb Ci;C2 for the dynamics (12.51) on a generic adjoint orbit. 

Since the system (|2.5p on a generic adjoint orbit is completely integrable ([I], [5], [TUJ, [H]), for the 
So(4) free rigid body we have a supplementary constant of motion. Using Mishchcnko's method [TU] , 
[18] , we obtain the following additional constant of the motion for the equations (|2.5[) commuting with 
H: 

I(M) = (A 2 + A 2 )* 2 + (A? + Al)^| + (A 2 + Xl)x\ + (A? + Al)y 2 + (A 2 + \\)yl + (A 2 + A^yf. 
Without loss of generality, we can choose an ordering for A^'s, namely 

Ai > A 2 > A 3 > A 4 . 
The following results on nonlinear stability hold [2J. 

Theorem 2.3. f^j The equilibria b , M_ a _ b 6 ti n Orb Ci;C2 are non-degenerate of center-center type 
and therefore nonlinearly stable on the corresponding adjoint orbit and also nonlinearly stable for the 
Lie-Poisson dynamics cm so (4). 

We denote by ai,a 2 (ai < a 2 ) the distinct real roots of the quadratic function 

f{t) = St 2 +ft + U, 

where 

S = (A 2 - A 2 ) 2 > 0; U = (A 2 - A3) 2 > 0; 
f = -2[(A 2 - A 2 )(A 2 - A 2 ) + (A 2 - A 2 )(A 2 - A 2 )] < 0. 
Theorem 2.4. J^j Under the hypothesis \\ + \\ 7^ A 2 + A 2 the following hold: 

(i) If € [0, ai) 7 £/ien £/ie equilibria M b a , M\ b _ a £ t% f] Orb Ci;C2 are non-degenerate unstable of 
saddle-saddle type on the adjoint orbit determined by a and b and hence are also unstable for the 
Lie-Poisson dynamics on so (4). 

(ii) If 772 G (0*1,0:2), then the equilibria M ba ,M}_ b _ a G ti fl Orb Ci;C2 are non- degenerate unstable of 
focus-focus type on the adjoint orbit determined by a and b and hence are also unstable for the 
Lie-Poisson dynamics on so (4). 
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(iii) If^e (a 2 , 1), then the equilibria M£ a , M x _ h _ a G tinOrb Cl ;C2 are non-degenerate stable of center- 
center type on the adjoint orbit determined by a and b and hence are also nonlinearly stable for 
the Lie-Poisson dynamics ok so (4). 

(iv) If ^ = (Xi, then the equilibria M b a , M\ b _ a G ti l~l Orb Ci;C2 are degenerate and unstable on the 
adjoint orbit determined by a and b and hence are also unstable for the Lie-Poisson dynamics on 
so(4). 

( v ) If = a 2, then the equilibria M£ a , M\ b _ a G ti nOrb Ci;C2 are degenerate and the stability problem 
on the adjoint orbit determined by a and b remains open. However, these equilibria are unstable 
for the Lie-Poisson dynamics on so (4). 

Theorem 2.5. Under the hypothesis \\ + A| = A?, + A 2 the following holds: 

(i) // |r € [0,«i), then the equilibria M\ a ,M x _ h _ a G ti fl Orb 

ci;c 2 are non-degenerate unstable of 

saddle-saddle type. 

,2 1-1 

(ii) J/^i e (0,1,1), then the equilibria M ba ,M_ b _ a G ti n Orb Ci;C2 are non- degenerate unstable of 

focus-focus type. 

(iii) If ^ = ax, then the equilibria M ba , M\ h _ a G ti fl Orb Ci;C2 are degenerate and unstable. 
Thus these equilibria are also unstable for the Lie-Poisson dynamics on so(4). 

Theorem 2.6. All four equilibria in t% n Orb Ci;C2 are non-degenerate of center-center type and 
therefore nonlinearly stable on the corresponding adjoint orbit. These equilibria are also nonlinearly 
stable for the Lie-Poisson dynamics on so (4). 

Theorem 2.7. |1J/ All four equilibria in t2 fl Orb Ci;C2 are non-degenerate, of center-saddle type and 
therefore unstable on the corresponding adjoint orbit. Thus these equilibria are also unstable for the 
Lie-Poisson dynamics on so (4). 

3 Nonlinear stability using energy methods for equilibria with- 
out bifurcation behavior 

Wc study nonlinear stability using Arnold's method, which is equivalent [3] with Energy- Casimir method 
[9] and with Ortega- Ratiu method [12] , for the equilibria listed in Theorems 12.31 and 12.61 The nonlinear 
stability of these equilibria has been proved in [2] using a Lie-theoretical result of Williamson. In this 
section we will find a Lyapunov function for these equilibria. 

For the equilibria M\ h and M\ a _ b in ti fl Orb Ci;C2 the computations are more precisely as follows. 
Consider the smooth function F mn G C°°(so(4), K), where m,n are real numbers 

F mn {M) = I{M) + mCx{M) + nC 2 (M). 

Choosing m, n such that dF mn (M x b ) — and taking into account that d 2 F mn (M x b )\wxw is indefinite, 
where W :— ker dC\(M x b ) fl kerdC < 2(M ( J b ), Arnold's method shows its limitations when used with the 
constant of motion /. 

Using Arnold's method with the Hamiltonian of the system, i.e. an energy function of the form 
F mn (M) = H(M) + mCi(M) + nC 2 (M), we obtain that equilibria M\ b and M\ a _ b are nonlinear 
stable under the sufficient conditions on \ and respectively on a, b: 

Ai + A4 < A2 + A3 

and 

(A 1+ A 4 ) 2 
« 2 (A 2 + A 3 ) 2 ' 
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These stability conditions were also obtained in [T5]. This stability result is weaker than Theorem [ 

From the above considerations it becomes necessary to look for a Lyapunov function that involves 
all four constants of motion, 

F^ 2 := fnH + ll 2 I + mCi + nC 2 , (3.1) 

where fxi , /i 2 , m, n G M. 

In [T7] it has been presented another set of constants of motion for the so (4) rigid body. Following 
the same ideas as in [5] , we approach the stability problem by energy methods using these constants of 
motion. They have simple and elegant expressions: 



Gi(M) 



\2 \2 \2 \2 \2 \2' 

A x — A 3 A x — A 2 A 1 — A 4 



G 3 (M) 



G 4 (M) 



A 2 ~ ^3 ^2 — ^1 ^ 2 — A| 



2/1 



A3 ~ ^2 A 3 _ ^1 A3 - A 4 ' 



2/1 2/1 2/1 



\2 \2 1 \2 \2 \2 \2 

A 4 — Aj A 4 — A 2 A 4 — A3 

By direct computation we observe that Gk, k — 1, 2, 3, 4, are of the form (|3.1j) . More precisely, 
• Gx = lit ■ H + [X2 • I + rn' ■ C\, where 
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A 4 )' 
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+ A 4 )(Ai -A 3 )(A 2 


-A 3 )(A 3 


-A 4 )' 



G 



• G 4 — \i\ ■ H + fi 2 ■ I + m' ■ C\ , where 

2(A 1 +A 2 )(A 1 +A 3 )(A 2 + A 3 ) 



Ml (Ai + A 2 + A 3 + A 4 )(Ai - A 4 )(A 2 - A 4 )(A 3 - A 4 ) ' 

1 

M2 ~ ~ (Ai + A 2 + A 3 + A 4 )(A! - A 4 )(A 2 - A 4 )(A 3 - A 4 ) 5 



to' 



2(Xj + A 2 + A 2 + AiA 2 + AiA 3 + A 2 A 3 ) 



(Ai + A 2 + A 3 + A 4 )(Ai - A 4 )(A 2 - A 4 )(A 3 - A 4 ) ' 

For the equilibrium M\ b in ti n Orb Cl ;C2 let us consider the Lyapunov function F^ 2 e G°° (so (4) , R) 

i™(M) = G 3 (M) + md(M) + nC 2 (M), 

where to, n are real numbers. 

Choosing m,n such that dF^ 2 (M^ b ) = and denoting W := ker dCi (M * |6 ) n kcr dC 2 (M^ b ) we 
obtain the determinants associated with all upper-left submatrices of the Hessian d?F^ 2 [M\ b )\ wx w 

a 2 (A 2 -A 2 ) + & 2 (A 2 -A 2 ) 
1 ' (A 2 -A 2 )(A 2 -A 2 )(a 2 -6 2 ) > U ' 
n -4„ 2 ^ 2 (Af-A|) + 6 2 (A|-AD 

' (A? - A 2 )(A 2 - A2) 2 (a 2 - 6 2 ) 2 > ' 
\ 2 - \ 2 

n _ o„4 A l A 2 n . 

•(A 2 -A 2 )(A 2 -A 2 )3(a 2 -6 2 ) 2>U ' 

n _i fi „4 (Ai - A 2 )(A^ - AJ 

4 " ' (A? - A 2 )(A 2 - A|)(A 2 - A 2 )> 2 - 6 2 ) 2 > °" 

It follows that d 2 F^ l2 (M^ b )\wxW is positive dehnite and thus the equilibrium M* 6 in ti n Orb ci;C2 
is nonlinear stable. A similar computation proves that the equilibrium M\ a _ b in ti n Orb Ci;C2 is also 
nonlinear stable. 

Analogously, for equilibria b and M^_ a _ b in t 3 fl Orb ci;C2 a convenient Lyapunov function for 
applying Arnold's energy method is F££ 2 (M) = Gi(M) + mCi(M) + nC 2 (M), while for equilibria 
M ba and M^_ b _ a in t 3 n Orb Ci;C2 a convenient Lyapunov function for applying Arnold's energy method 
is F^ 2 (M) = G 4 (M) + mCi (M) + nC 2 (M). 

Thus, we have obtained the following result: 

Theorem 3.1. Using Lyapunov functions, we have the following stability results, 
(i) The equilibria b , M\ a _ b are nonlinear stable with Lyapunov function 

F mn 2 ( M ) = G 3 (M) + mCi(M) + nC 2 (M). 
(ii) The equilibria M i b7 M^_ a _ b are nonlinear stable with Lyapunov function 

KT(M) = Gi(M) + mCi(M) + nC 2 (M). 

(Hi) The equilibria M b , M_ b _ a are nonlinear stable with Lyapunov function 

F^ 2 {M) = G 4 (M) + mCi(M) + nC 2 (M). 
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Ar = 16(A 2 - \ 2 2 ){\\ - A 2 )(A 2 - Ai)(A| - A 2 ) > 0. 



4 Spectral stability for equilibria with bifurcation behavior 

As we have seen in Theorem 12.41 for equilibria M^ a ,M^ b _ a bifurcation in the stability behavior 
does occur. In this section we aim to find the region of spectral stability for the equilibria M J a and 
^I-b -a- Notice that from Theorem 12.61 we have a £ (0, oo),b <E [0, oo) and b < a, which also implies 
that < ^ < 1. 

Before we start the spectral stability analysis, we need a few considerations about the position on 
the real line of the roots oti < a 2 of the function / defined in Section 2. The discriminant of / is given 
by 

Since Aj > 0,— ~ > and ~ > 0, the quadratic equation associated to / has two distinct strictly 
positive real solutions. We notice that /(l) = (A? + A| — A| — A§) 2 > and 

T__. (Ag - Aj)(Ag - Aj) + (Aj - Al)(Aj - Aj) 
2S (A?-Ai)2 

which implies the following ordering 

< a% < «2 < 1< 

The above computation also shows that ^ 1 if and only if \\ + A| ^ \\ + A§. 

The characteristic equation for the linearized system Lj^i Xh |orb cl . C2 is given by 

ut 4 + vt 2 +w = 0, (4.1) 

where 

u = (Ai + A 2 )(Ai + A 3 )(Ai + A 4 ) 4 (A 2 + A 3 ) 4 (A 2 + A 4 )(A 3 + A 4 ) > 0; 
w = (Ai - A 2 )(Ai - A 3 )(A 2 - A 4 )(A 3 - A 4 )[(A 2 + A 3 ) 2 a 2 - (Ai + A 4 ) 2 6 2 ] 2 > 

and 

W = -2(A 1 + A 4 ) 2 (A 2 + A 3 ) 2 a 2 T /S 



T 



We have made the notations 

S = (A 2 + A 3 ) 2 E 2 ; E 2 = -(A 2 + A 4 A 4 )(A 2 + A 4 A 4 ) + A 2 A 3 (A! + A 4 ) 2 

and respectively 

T = (Ai + A 4 ) 2 Ex; E 1 = (A 2 + A 2 A 3 )(A 2 + A 2 A 3 ) - AxA 4 (A 2 + A 3 ) 2 . 

Next, we will prove that T > 0. Indeed, if A 4 < 0, from the conditions A^ + Xj > we obtain 
< A 3 < A 2 < A 4 and consequently, T > 0. If A 4 > 0, then A 2 + A 2 A 3 > A 4 (A 2 + A 3 ) as it is equivalent 
with (Ai — A 2 )(Ai — A3) > and A| + A 2 A 3 > A 4 (A 2 + A3) as it is equivalent with (A 4 — A 2 )(A 4 — A3) > 0. 
By multiplication we obtain that E\ > and consequently, T > 0. 

In equation (14. ip we denote i 2 — s and the discriminant of the corresponding quadratic equation is 

A = 4(Ax + A 4 ) 6 (A 2 + A 3 ) 6 (A!A 4 - A 2 A 3 )V/ ( ''' 



Now, we study the position of ^ with respect to the roots a 4 , a 2 . We notice that 

f[S\ (A 2 -A 2 )(A 2 -A 2 )(A 2 -A 2 )(A 2 -A 2 )(A 2 + A 3 ) 2 (A 1 A 4 -A 2 A 3 ) 2 
J \Tj ^ 2 (A 1+ A 4 ) 2 

and consequently a.\ < S; < a 2 - 
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We discuss the spectral stability problem for L M i Af/|o r b cl . C2 by analyzing the position of the num- 
ber in the interval [0,1). Taking into account the expression of A, the following two cases: (I) 
A1A4 7^ A2A3 and (II) A1A4 = A2A3 arise naturally. 

Case I (A1A4 7^ A2A3) 

In this case f (§) < and consequently, ai < f < 02- 
Subcase 1 ^ £ [0, ai). 

We have ^2 < «i < § , which implies y — ^2 > and consequently, v < 0. Also A > as we are outside 
the roots of /. It follows that the equation us 2 + vs + w = has two distinct real positive roots Si < s 2 , 
where at least the root s 2 is strictly positive. Solving t 2 = s 2 , we obtain that equation (14.11) has at least 
a solution with strictly positive real part, which implies spectral instability. 

,2 

Subcase 2 \ = ai. 

Then, = «i < |, which implies v < 0. Also A = 0. It follows that the equation us 2 + vs + w = 
has a double real strictly positive root. Consequently, as before, we obtain spectral instability. 

Subcase 3 ^ 6 (0:1,02). 

Then, A < 0. The characteristic equation (|4.1[) has complex roots of the form ±A±iB, with A,BgR*. 
We obtain again spectral instability. 

Subcase 4 ^ € [«2,1)- 

If X 2 + A| = A?, + A§, then a,% = 1 and consequently, the previous three subcases completely cover 
the interval [0,1). 

Next, we analyze the situation when A 2 + A 2 7^ A?, + A§. Then, 02 < 1 and we consider ^ € [ct2, 1). 

a) ^2 = «2- Then, A = 0. Also f < 0:2 = ^2, which implies ^ — ^2 < and consequently, v > 0. The 
equation us 2 + vs + w = has a double real strictly negative root. Then, equation (|4.1[) has two double 
conjugate purely imaginary roots; we are in the case of spectral stability. 

b) ^2 G (ck2, !)• Then, A > 0. Also f < «2 < ^2, which implies f — ^2 < and consequently, v > 0. 
The equation us 2 + vs + w = has two distinct negative real roots, at least one of them being strictly 
negative. Then, equation (|4.1[) has roots of the form ±%A and ±i_B, i ^ B,i > 0,B > 0. We are in 
the case of spectral stability. 

Case II (A1A4 = A2A3) 

First of all, we notice that in this case A 2 + \\ 7^ A 2 , + A§; otherwise, one would obtain Ai + A4 = A2 + A3 
and consequently, we obtain the set equality {Ai,A4} = {A2,A3}. This, in turn, would contradict the 
initial hypothesis Ai > A2 > A3 > A4. Thus, for this case we have a% ^ \. We have A = and 
/(f) = 0. By direct computation, a x = fxiZ-^) 2 &nd " 2 = ^ = (l^-A^ • 

Subcase 1 ^ 6 [0,02). Then, f = 02 > ^2-, which implies f — ^2- > and consequently, u < 0. 
As in case I we obtain that equation (|4.1[) has double roots of the form ±A, with A > 0. We are in the 
case of spectral instability. 

Subcase 2 ^ — ot2- Then, f = -t-, which implies u = 0. The equation its 2 + vs + w = has 
as a double solution. Consequently, equation (|4.1[) has as a root of multiplicity 4; we are in the case 
of spectral stability. 

Subcase 3 ^2 e (a.2 , 1). Then, 02 = f < ^2, which implies t> > 0. The equation us 2 + vs + w = 
has a double strictly negative real solution. Consequently, equation (|4.1[) has double conjugate purely 
imaginary roots, which leads to spectral stability. 

Identical results hold for the equilibrium M_ b . The above discussion can be summarized as 
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follows: 

Theorem 4.1. The equilibria Mr and M\ have the following spectral stability behavior: 

(i) if A 2 + A| = A 2 + A§, then M\ a and M\ h _ a are spectrally unstable; if A 2 + A| 7^ A 2 + A§, fften 

_ a are spectrally unstable for ^ £ [0,02). 

(ii) if Af + A| 7^ A2 + A§, then M£ a and M^_ b _ a are spectrally stable for ^ & [^27 !)• 
We notice that this result is in agreement with Theorem 12.41 and Theorem 12.51 



5 Nonlinear stability using energy methods for equilibria with 
bifurcation behavior 

For the equilibrium M^ a , under the condition A 2 + A| 7^ A 2 . + A 2 , we have found spectral stability for 

^7 £ [«2, 1)- For the equilibrium M£ a in ti n Orb Ci;C2 it is natural to choose a Lyapunov function of the 
form -F/^" 2 — G2 + mC\ + nC2- Applying Arnold's method we find indefiniteness. We will introduce 
an additional degree of freedom and thus we search for a Lyapunov function of the following form: 

F ™ = H+ 2(A, + A 3 )(A 1 + A 4 )(A 3 TXT)' P • 1 + m • Cx + n • ° 2 - 

The coefficient — — ; . . , , . , -- r is equal with — , where Ui,it2 are the coefficients that 

2(Ai + A 3 )(Ai + A 4 )(A3 + A4) 4 ^ 
appear in the expression of G2 ■ 

Choosing m, n such that dF^ n {Ml a ) = and denoting W := ker dCi(M b a ) nkerdC2(M* a ), we obtain 
the determinants associated with all upper- left submatrices of the Hessian d 2 F^ n {Ml a )\w xW- 

(Sm 2 - T^p + S{a 2 + T[b 2 



(Ai + A 3 )(Ai + A 4 )(A 2 + A 3 )(A 3 + A 4 )(a 2 - b 2 ) ' 
We denote D[ := (S ia 2 - T x b 2 )p + S[a 2 + T{b 2 , where: 

Si = (A 2 + A 3 )(A 2 - A 2 ) > 0;Ti = (A 2 + A 3 )(A 2 - A 2 ) > 0; 
Si = -(A 2 + A 3 )(A 2 - \\)-T[ = (Ai - A 2 )(A X + A 4 )(A 3 + A 4 ). 

D[ ■ [(S 2 a 2 - T 2 b 2 )p + S 2 a 2 + T!p\ 

' 2 (A 1 +A 2 )(A 1 +A 3 ) 2 (A 1 +A 4 ) 2 (A 2 + A 3 ) 2 (A 3 + A 4 ) 2 (a 2 -6 2 ) 2 - 
We denote D' 2 := (S 2 a 2 - T 2 b 2 )p + S' 2 a 2 + T' 2 b 2 \ where: 

S 2 = (A x + A 2 )(A 2 + A 3 )(A 2 - A 2 ) > 0; T 2 = (A x + A 2 )(A 2 + A 3 )(A 2 - A 2 ) > 0; 

S' 2 = -(Ai + A 3 )(A 2 + A 3 )(A 3 + A 4 )(A 2 - A 4 );T^ = (Aj + A 3 )(A 4 + A 4 )(A 3 + A4XA1 - A3). 

£> 2 (S 3 P 2 + T 3 p + U3KX1 - A 2 )(A 3 - A 4 ) 

3 (A 1 + A 2 )(A 1 + A 3 )3(A 1 + A 4 )3(A 2 + A 3 ) 3 (A 2 + A 4 )(A 3 + A 4 ) 2 (a 2 -6 2 ) 2 ' 
We denote g(p) := S 3 p 2 + T 3 p + U 3 , where: 

5-3 = (A 4 + A 2 )(A 2 + A 4 )(A 2 + A 3 ) 2 (a 2 - b 2 ) > 0; 

T 3 = -2(A 2 + A 3 ){(A 2 + A 3 )[(A! + A 2 )(A 2 + A 4 ) + (Ai + A 3 )(A 3 + A 4 )]a 2 - 

- (A 4 + A 4 )[(A! + A 2 )(A 4 + A 3 ) + (A 2 + A 4 )(A 3 + A 4 )]6 2 }; 
U 3 = (A x + A 3 )(A 3 + A 4 )[(A 2 + A 3 )V - (Aj + A 4 ) 2 6 2 ]. 
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(Ai - A 2 )(Ai - A 3 )(A 2 - A 4 )(A 3 - X 4 )(S 3P 2 + T 3P + U 3 ) 2 
4 (A 1 +A 2 )(A 1 +A 3 ) 3 (A 1 +A4) 4 (A2 + A 3 ) 4 (A 2 + A4)(A3 + A 4 )3( a 2-62)2- 

We are looking forpGt such that HessF^^M^ a )\w xw is definite. This is equivalent with D\D 3 > 
0, D 2 > 0,L> 4 > 0. We notice that DxD 3 has the sign of -D[D' 2 g(p). Since D 2 has the sign of D[D' 2 , 
for definiteness we need to have g(p) < 0. Thus, definiteness is equivalent with the existence of a real 
number p such that 

D[(p)D' 2 (p) > 0, g(p)<0. (5.1) 

We distinguish two cases: (I) X\ + X\ < A 2 . + Xj and (II) A 2 + \\ > X\ + A 2 . 

Case I A? + X\ < X 2 2 + A| 
We notice that & = > 1 > 4 and & = > 1 > 4, thus & _ 4 > o and fa - 4 > 0. 

It follows that the linear functions D[(p) , D' 2 (p) , as functions of variable p, are strictly increasing and 
the associated equations D[(p) — and D' 2 (p) = have each a unique root, which we denote by pi, 
respectively p 2 . We notice that 

(A 2 - A 3 )(A 2 - A 4 )(A| - A 2 )(A 4 + A 2 + A 3 + A 4 )(a 2 - b 2 ) 
Pl~P2 = 7- oX 7- rr > 0, 



a 2 (X 2 - Al)(Af - Al)(Ar + A 2 ) (f - *) (f - *) 



which implies p\ > p 2 . 

By direct computation we obtain that the discriminant of the quadratic equation g(p) =0 is 
A 3 = T 2 - 4S 3 U 3 = (A! + A 2 + A 3 + A 4 ) 2 (A 2 + A 3 ) 2 a 4 / 

For ^ = a 2 we have that A 3 = and consequently (15.11) does not have a solution. 

For \ > a 2 we have A 3 > and the equation g(p) = has two distinct real roots, which we denote by 

P3 < Pa- 

In order to solve the system of inequalities (|5 . 1 [) we need to study the position of p\ , p 2 with respect 
to P3,Pi- For this, we need the following computations: 

= b 2 {X 1 - A 2 )(A 2 - A 4 ) 2 (A| - AfXAi + A 2 + A 3 + A 4 ) 2 (a 2 - b 2 ) > Q 
a 2 (X 1+ X 2 )(X 2 -X 2 )(^-^) 2 

and 

f , 6 2 (A 2 -A 4 )(A 2 -A 2 ) 2 (A 1+ A 2 + A 3 + A 4 ) 2 (a 2 -6 2 ) 

9(P2) — 2 > U. 

a 2 (A 1 + A 2 )(A 2 -A 2 )(§ -£) 

Consequently, pi and p 2 are outside of the interval (p 3 ,p 4 ). 

Next, in order to compare p\ with the minimum point — of the parabola g(p), we prove: 

Lemma 5.1. If A 2 + A 2 < A 2 . + A§, i/ien the following inequality holds: 



Proof. By direct computation we obtain 



Pi 



„ x , (Ai + A 2 + A 3 + A 4 )6 4 

_t_3_ \ 1 

2S 3 



'»/ 2 (Ai + A 2 )(A 2 + A 3 )(A 2 + A 4 )( a 2 -6 2 ) a 2 (A 2 -A 2 )(^-^)' 
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where: 



S4 = (A 2 -A 2 )(A 2 -A 2 )>0; 



T4 — 2 Ai 2 A3 2 — 3 A4 2 Ai 2 + Ai 2 A2 2 + 4 A2 2 A4 2 — A2 4 + A4 2 A3 2 — 3 A2 2 A3 2 — A4 4 ; 
f/ 4 = -(A 2 -A 2 )(A 2 -A 2 ). 

We denote h\(t) := Ut 2 + Tt + S and h2,{t) := S±t 2 + T^t + U4. Obviously, the quadratic equation 
h\(t) = has the roots ^ < We notice that the quadratic function h 3 (t) := hi(t) + h 2 (t) has the 
distinct real roots: 

A 2 - A 2 

Oi = 1; 6*2 = -2 T2 > 1. 

A 2 - A 3 

It follows that 

h 3 (t) = (S A + U)(t-l) (t- x 



^2 - A3 



It is easy to see that 5 4 + U = (\j - A 2 )(A^ - Xf) > 0. Also 



, ,' A 2 -A 2 A 4(A 2 -A 2 )(A 2 -A 2 )(A 2 -A 2 ) 

ft l I T2 T2 V2 V2 < U > 

A 2 - A 3 J A 2 - A 3 



A 2 -A 2 1 

which implies that — < A — A < — . 

Consequently, we have that fl, C f 1, p ^ j , which implies that for f £ fl, we have that 
/13(f) < 0, which leads to /i 2 (f) < — < 0. Since j£ G fl, one obtains /i 2 ( frj < 0. This implies 

pi-(-i5r)< -" 

The above Lemma implies the following ordering 

P2 < Pi < P3 < Pi- 

The system of inequalities (|5.ip has as solutions any p 6 (^3,^4); for such p we have D[(p) > 0, 
D' 2 (p) > and g(p) < 0. In conclusion, there exists a real number p such that HessF^ l „(M b 1 a )| wx w is 
positive definite. 

Case II A 2 + A 2 > A 2 + A 2 

First of all, as we did in Case I, we need to establish the signs of the expressions — ^ and — p-. 
By direct computations we obtain 



(S) 



(Aj-A 2 )(A 2 + A 2 -A 2 -A 2 ).£ 
(A 2 -A§)3 



where 

E = —3 A2~A3 — A2 A4 + 4 Ai A2 + A3 — 3 A4 Ai — Ai A3 +2 A4 A3 + A4 . 
In order to decide the sign of the expression E, we make the following notations: 

A 2 := A 2 — A 2 , A3 := A 2 — A 2 ,, A4 := A 2 — A 2 . 

From the ordering Ai > A2 > A3 > A4 we obtain that A4 > A3 > A2 > 0. We have 

E = 2A 3 (Ai - A 2 ) + Ai{A A - A 2 ) + A 3 (A 3 - A 2 ) > 0. 

Consequently, / (ff) < 0, thus || < a 2 - Since ^ G [a 2 , 1), it follows that || - ^ < 0. 
We also have 

Si S2 _ (A 2 — A 3 )(Aj + A 4 — A 2 — A 3 ) 



T X T 2 (A?-A 2 )(A 2 -A 2 ) 



<0, 
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which implies < §r- < K and consequently, — K < 0. 

It follows that the linear functions D' 1 (p) , D' 2 (p) , as functions of variable p, are strictly decreasing 
and the associated equations D' 1 (p) = and D' 2 (p) — have each a unique root, which we denote by 
pi, respectively p 2 . We notice that 

(A 2 - A 3 )(A 2 - A 4 )(A 2 - Ai)(A a + A 2 + A 3 + A 4 )(a 2 - b 2 ) 

Pl~P2 = 7- oN / -T > 0, 



2 (A 2 ~ A|)(A? - A|)(A! + A 2 ) (f - ») (f - £) 



which implies pi > p 2 . 

By direct computation we obtain that the discriminant of the quadratic equation g(p) = is 



A 3 = T 3 - 4S 3 [/ 3 = (Ai + A 2 + A 3 + A 4 ) 2 (A 2 + A 3 ) V/ -5 



For ^j- = a 2 we have that A 3 = and consequently (|5.ip does not have a solution. 

,2 

For ^2 > a 2 we have A 3 > and the equation g(p) = has two distinct real roots, which we denote by 
P3 < Pa- 

In order to solve the system of inequalities (|5.1I) we need to study the position of p\ , pi with respect 
to P3,Pi- For this, we need the following computations: 

, > _ b 2 (X 1 - A 2 )(A 2 - A 4 ) 2 (A 2 - AjKAi + A 2 + A 3 + A 4 ) 2 (« 2 - b 2 ) 

fJ\Pl) . o > u 



and 



g(P2 



« 2 (A 1+ A 2 )(A 2 -A 2 ) (§-£) 
& 2 (A 2 - A 4 )(A| - X 2 ) 2 (X 1 + A 2 + A 3 + A 4 ) 2 (a 2 - b 2 ) 



a 2 (A 1 + A 2 )(A 2 -A 2 )(f -g) 

Consequently, pi and pi are outside of the interval (p 3 ,p 4 ). 

Next, in order to compare p 2 with the minimum point of the 

Lemma 5.2. //A 2 + A| > A 2 + A§, i/iera i/ie following inequality holds 



> 0. 



P2 



2S 3 



> 0. 



Proof. By direct computation we obtain 



P2 



2S 3 



(Ai + A 2 


+ A 3 + A 4 )6 4 


s 5 






(Ai + A 2 )(A 2 + 


A 3 )(A 2 + A 4 )( 


a? - 


-6 2 )a 2 (A 2 -A 2 )(f? 


b 2 \ 
~ 7?) 



where 



<?5 — (A 2 - A 2 )(A 2 - A 2 ); 

T5 = 3 A 4 2 Ai 2 — Ai 2 A 3 2 — 2 Ai 2 A 2 2 + A 3 4 — 4 A 4 2 A 3 2 + A 4 4 + 3 A 2 2 A 3 2 — A 2 2 A 4 2 ; 
^5-(A 2 -A 2 )(A 2 -A 2 ). 

We denote by h&(t) :— S§t 2 + T$t + U5. We notice that the quadratic function /15(f) := /14(f) — h\{t) 
has the distinct real roots: 



A 2 - A 2 
A 2 — A 2 



It follows that 



h 5 (t) = (S 5 -U)[t + 



< 0; 6 A 



A? - A 4 



1. 



(t-1). 
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It is easy to see that S5 — U = (A| — A§) (A| — A|) > 0. Consequently, for t > 1 we have that h§{t) > 0, 
which is equivalent to h^it) > h\{t) for all t > 1. Since p- € ^1, one obtains hi f fr) > hi (j^) > 0- 

This implies p 2 — ( — j^j > 0. ■ 

The above Lemma implies the following ordering 

p 3 < pa < p 2 < Pi- 

The system of inequalities (|5.ip has as solutions any p £ (p3,P4,). More precisely, for p £ (ps,P4) 
we have D[(p) > 0, D' 2 (p) > and g(p) < 0. In conclusion, there exists a real number p such that 
HessF^„(M h 1 a )| H / X M/ is positive definite. 

The nonlinear stability for equilibria M£ and M_ b _ a can be summarized as follows: 
Theorem 5.3. We have the following stability behavior on regular orbits Orb Ci;C2 .' 

(i) for € (CK2, 1) the equilibria M\ a and M\ _ _ a are nonlinear stable with Lyapunov function 



^"^ + 2(A 1+ A 3 )(A 1 +A 4 )(A 3 + A 4 ) / + TOCl + ^ 



where p £ (p3,Pa) 



(ii) for = a-2 the stability problem for the equilibria M^ a and M\ b _ a cannot be decided using the 
set of constants of motion {H,I,Ci,C2} (these equilibria are a case of unstable equilibria [21 that 
are spectrally stable); 

(Hi) for £ [0, 012) the equilibria M b a and M\ h _ Q are unstable. 
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